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. ♦* ' » ’ ■ . . . , . '■ 

J Recently, tlje student 'fatings of faculty and their courses.-has 

- •' ;* .. * -»■ ’» - 

become an'extremely popular, method of faculty evaluation.►. The, results 


of these ratings are used : not -only by the .faculty as a feedback to ^ ^ 

> •’ ,* * . * . ‘ % S ^ ' 

improve their teaching behavicP and classroom practices b.ut also by > * 

T « v . . < < 

the student governments in. helping the students, to make decisions 


regarding facility and course selections and by the college or unlver- 

» * „ * ; * » t «• 

>. gity administrators for making the -important facrulty decisions, like 


y' 



retentions, promotions and pay raises. In .spite {gf. the various uses ^ 
of the results of faculty evaluations,‘the students ape generally 

i * ' , . i • , 

given, the impression that .the results are going to be i^sed by their 
. instruOtqrs alone for self-improvement. The major purpose of this 
study .was* to investigate into the question: .What jfj^iAd happen if the 
students, are clearly , told that-the insults'of their evaluations will 


%c used.by different groups of pbopl ■ on campus, for different 

' . c ' - • • ; 

purposes? There*'are no studies done, to date, to see the effect o‘.f 




in 

CO 


.varied instructions on student ratings of- faculty. f^r^the purpose 


iO 


at this study, three different sets of instructions were written and 

. » , * 

used with the‘.’three experimental groins. Group A was told that the 
information from evaluation vill be primarily to aid the instructors . 
in Improving their i/structicVi. ' Gr^up B was told that the information 
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? • 


‘ *u 


»i ■ i ' ja . 


• . v . - - --1 v* > 

vill be used by the tail varsity administrat3rs'(deans and chairpersons) 

v ~ ■ v ; • 

to guide them in fatuity promotional. retentioni and pay raises, etc. 

• ‘ , \ ■ * -«• ! ‘ .* " ^ 

Group C was told..that the results of evaluation will be used by the 

• > - ^ ^ ‘ 

students on can® us to. guide them in cdursfe .and. irtstfuctor select ion-, 

V ' . . • - K ' . * ' . . ■ • ’ - 

" j i * • « 

at the time of registration.' It was hypothesized that the students^ ^ 

- i ■, * •.. . ’ ■ 

v , • t ' » i 

"getting different instructions for faculty evaluation will rate.their 

* * * *"* ^ t , 

instructors significantly differently, Further purposes ,of the 

» » • •» 

study were to investigate whether ^professoral ranks' are differentially 

• ■ ‘ • • 

evaluated as well as whether there is a difference in the. evaluation 

. , 

of graduate and undergraduate students. It was hypothesized that 

*: ‘ *• * - ... V.* 1 

the graduate-'Students will give significantly different ratings 

, * . . * .z'' * . , 

_ their instructors from the undergraduate students and that the stu- 
dents will give significantly different ratings to the instructors tl< 
in different ranks. - , 


Method 


* r> 


i Subjects . A - total of 850 graduate and undergraduate students 
evaluated forty graduate teaching assistants, assistant professors and 
full professors ,• on a large urban campus. ..All th‘e instructors va’lun- 

> . * * r • * ■ 

teered tc participate in the study. The average nunberof students 

• - . ' V . • • 

rer class Wr the classes used in the. study was 21.25. . 

‘ Materials. The main’instrument^used for faculty evaluation was 

i * . 

the IlliAoi? Course E^J.-m^cn^fijitfostiqnnaire (CEQ) (Aleamoni, 1972a; 
Alen^ni_^Spencerr-19J3)- -In addition to the total score, the CEQ 
yields six subs cores on six aspects of the to'tol instructional situ- , 
„ti-n • It takes- 10 minutes to administer and is machine scorable-. . 
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(Aleanonit 19 T 3 b) 




*•• ; Ah$dditional ites^ called ’Person* 






and used to enable the stuitenta*to -raie th^ ^instructors ,!$s 


.. 

no# ■ 


disregarfflpg tieljc characteristics *aa teachers,* : tt was, <a 


••• 


S«S?ife-•-••' 
feifc-V.: 


interesting tq find out^cv the ratings of instructors 'as 


tors! would.he’related .to tfcfcir *•ratings 'as pexsoni^vTT^ .- 

j ' 5> .. . ; •. ' .-V v . ."•-' _ // 

• Three .different purposes of .evaluation.were printed Separately *' v ; 

• ‘“V • % *. ’ -■* ’ - V - ' ' , \ ' "7 *•'# 

for ui^e with*.the ^ttaree ea^erinental grqups on green sheets of paper*; * - ’4 ' 

These ahetts were called the purpose of evaluation, sfieejw.-. ; w 

‘‘t ^ Thus, the ^materials us*e$LJay each' BubJectdjn this study Mnslitetf*'^^*”"^ 

■ • ’* . ^ ■ ... • •• -*\ • * *. . ■ .*■ * '*■ * >’ 

of a copy of thp CSQj a copy* of the P item, a purpose of evaluation ' ' 

' "• . .. ' -v l V ;* . .• . * ■ - >' 

sheet for a particular experimental group.’ » • 



this study consist 


* \ Procedure . The data was collected during the regular class, time-, 
in regular-classrooms ■ and during the laBt three weeks of an academi®-^ 


term . 4 ' Thtj pre—prepared packages of materials..when /distributed in a 

* > « f * • * ' ‘ . . • ■ * 


class, automatically divided the students in each’ clasS into three ' * 


experimental groups to study'the .effect of three'"different sfets Of.-' , •/£.. 

T . r ; . • . ■ . ‘ •' . • 


.Instructions on faculty evaluation. The instructors were requested f ' 


to .leave the-classroom during evaluation so that the* students may j ' 

’ - ‘ ' , . ff fg‘ 


evaluate them under non-* threatening situation. 


"Results 


* *’ » 

Multivariate analysis ©f variance {MANOVA), factorial design was 

/ , # A . 

used as the statistical procedm’e to -analyze the daia. since' the* study^ 





. O ' ' V- V * 


^ 






involved ti<e simultaneous amiyais of'multiple Independent variables 

: v\y.- v -> .7 ;-•■•- v 'r ■-•. •*; -. • # \ _ •;/ 

\ and ipultiple dependent var^itlerf.,. In addition -to the underlying astna 

■■Ktianfs^eoingaa -vita ANOVft,' MH&3&'assumes relatedness of, the dependent 

.• • ';• * . ^ : . 

VBTiab\fes (Cooley-4 ,L3hnes f 32*71; Kirk, 2<jrt&)Y In order to <?heck thii 

•„relatfedness-v i^tercorreiatlons among"the dependent variables were' 

•— "• '» ■ • , v * *• . ■ v " 

donputed before d6ing jg^ROV/il All’ correlations wei'efouijd to be 

positive, arid signt’fLfchnt (p '/£. .Olf. - * 

’ * , v - • *.-• • ''V- 

' ' -fee/ effect, of the different, sets *of instruction* for faculty^ 

* ■ I .. ?>.; • V.-.-'./f ' * *. " 

•evaluation mas fatjnd to be*^statistically nonsignificant (p\-.05)» 

. . • • - . . • • ^ . 

Tl\e effect pf class (graduate .versus undergraduate classes) was found 


» .V< 

• *5. a 


— to be^sicniflcant fp ^ :05). ‘ The graduate students tended to assign 

ratings to their instructors than did the undergraduate students,. 

Y - I —/• ,.v , 

The effect of faculty rankfcas also found.to be aigniflcant (p. < .Q5) 

• . ' 11 ~ i ‘ 

on the faculty evaluation, ^he Newmarf KeulS tests (Kirk, 19'66) vere 
applied to -pinpoint the'differences among.the different faculty ranks. 
On .the whole, the graduate teaching assistants tended to get signlfi- 

- . ■* , r * • ’ * • \ ^ 

; * ' - 

higher ratings than. di,^. assistant, and full professors. The 

univariate analydis was also dOn,e' for each of the dependent variables, . 

. '* * ' - • * t ■ 9 > 
to verify the results Of nultivariate analyses. In all cases * the 

^ • . * , 

' results of univariate, paalyses were consistent with the results of 

the .nultivariate analyses.. . ’ ' ' , 

• Discussion , • * *. 

'Ther'e is. no previous researjchi^eridence to support or to contra¬ 
dict the finding that ’the students getting different instructions for 


faculty evaluation did not’ rate their instructors differently. It is 


• *5 ' 




ius&'pcsWible that while evaluating their instructors even under 
^different instructions, -the students operated.under the set created 

* m * » ,* 

..by the‘repeated use of standard instructions given-'to* then-for faculty . 

«' * t + * *• i' • y .* 

. evaluation, tern - after terra, dhe to- that set, -they, perhaps; fevalu- 
atedptheir instructors as if under the* same standard instructions. - .* 

• ..V The • finding that the graduate .students assigned significantly 

. if * 

t 9 ' ’ 

higher‘gatings to’ their instructors* than fid the undergraduate students 

j" -* j , . *-. ' 

is supported by research evidence from several Studies such as ■ 

• V * , 

Dovnie (1952); Ga^e (lS>6l); an'd Lovell and Haner- (1955) • All these 

studies reported that more advanced stv^dents - tended to give more ^ 

, . ^ . __ 

' favorablb ratings to their instructors than less advanced students. 

The graduate classes are generally smaller, and, therefore, allow 
better student-teacher interaction; have more mature students who are 

tolerant to the individual teaching /tyles of their instructors; and 

• * * 

are taught by the everts in their areas. , Pue- to such reasons, the 
'higher ratings of the graduate courses and. their instructors seem to 

be Justifiable. ’ - *'C 

The finding that x the graduate teaching assistants tended to get 


•hioher rhinos than did the assistant aryl full professors is also . 
neither supported* nor contradicted by any previous research evidence.' 
-M'-st of the previously done studies (e:-g. Downie, 1952; Gage, 196l) 

* y 

compared the ratings of only the different ranks within the. regular- 

full tine faculty. Nog study compared the graduate teaching assistants 
. -< - 

-lit 


vith the Regular full tine faculty. There seems io be at least one 
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l , 




6 




* * 


, * 




major reason for the. higher fatings.jpf the graduate teaching assistants. 
Knowing that the graduate teaching ^assistants are also primarily the. 

students ‘like’them, the students may have identified themselves more - 

* v \ • - 

closely, with them.. They may have assigned higher ratings to them 

* - • •.V * ", - ‘ 

with the sympathy that the graduate tejachlng- assistants are^also 
students whp are. contending with the regular faculty .^Because of this , 
closeness* they may have liked them better 'as persons'. Very"iiigh 
significant positive ,ccop*el*xtion (p < .OJ.) between the ratings .of 
instructors 'as instructors', with their rhtljlgs 'as pers ons' for^nd 
in this study suggests that an instructor may get high ratings £S a 

t ' - * p * * 

teacher hot necessarily because he possesses all the characteristics s 

of a good^teacher but simply .because ,he is liked by his students, '.as 

' • ■' ;\ -■ • ^ ‘ 7: . • • - ■ 

a person' . Under these cipcitnstances of lesser hostility and more- 

v * * 

sympathetic attitudes, the graduate teaching assistants may have.been 
assigned’higher ratings. ^ - * * , 

In summary', it nay be stated that firstly, on large urban 
carp uses, the results of Just one comprehensive faculty evaluation 

V V 

system may be* sufficient for* use by all groups on campus.; secondly, 

% K . 

the-graduate students, nay be expected tcToasaign h-irher ratings 



nas 


their instructors than-the undergraduate students; thirdly, the / 
graduate teaching assistants nay he expected to get different ra^i 

v. * 

fjym the regular full time faculty; and finally, the instructors who 
-are liked by their students as persons, may also, be expected to get 
higher ratios' as instructors. ' 

* - V\ 7' 
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